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ABSTRACT 

The  paper  considers  the  control  of  an  unknown  linear  time-invariant 
plant  using  Direct  and  Indirect  Control.  Using  a specific  controller 
structure  and  the  concept  of  positive  realness,  adaptive  laws  which  are 
identical  are  derived  for  the  two  cases.  The  stability  questions  that 
arise  are  also  shown  to  be  the  same.  Simulation  results  are  presented 
towards  the  end  of  the  paper  to  demonstrate  the  effectiveness  of  the  new 
scheme  proposed. 
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INTRODUCTION;  The  control  of  an  unknown  linear  time- invariant  plant  has  remained 
an  open  problem  for  a long  time  and  in  recent  years  there  have  been  many  attempts 
to  resolve  it  (Landau,  1972;  AstrSm  and  Wittenmark,  1973;  Monopoli,  1974;  Feuer 
and  Morse,  1977;  Narendra  and  Valavani,  1977).  The  methods  used  for  the  resolution 
of  the  adapt ive  control  problem  can  be  broadly  classified  as  (i)  Indirect  Control 
and  (ii)  Direct  Control  methods.  In  the  former,  the  parameters  and/or  state  vari- 
ables of  the  unknown  plant  are  estimated  and  these,  in  turn,  are  used  to  adjust 
the  parameters  of  a controller.  Such  control  systems  have  also  been  referred  to  as 
self  tuning  regulators  (Astrom  and  Wittenmark,  1973)  in  the  literature.  In  direct 
control  there  is  no  explicit  identification  of  the  plant  but  the  control  parameters 
are  adjusted  so  that  the  error  between  plant  output  and  that  of  a reference  model 
(called  the  desired  output)  tends  to  zero  asymptotically.  Direct  control  systems 
have  also  been  called  model  reference  adaptive  systems  (Landau,  1972). 

No  matter  which  method  is  used,  the  difficulties  associated  with  the  control 
problem  arise  from  two  sources.  The  first  stems  from  the  fact  that  the  plant  is 
essentially  a black  box  and  only  the  input  is  accessible  for  control  purposes. 

This  raises  the  question,  which  is  strictly  algebraic  in  nature,  as  to  whether  a 
controller  structure  exists  which  can  generate  the  appropriate  control  input  u(t). 

It  is  now  well-known  that  the  answer  to  this  question,  whether  direct  or  indirect 
control  is  used,  is  positive. 

The  second  problem,  which  is  purely  analytic  in  nature,  is  concerned  with  the 
generation  of  adaptive  laws  and  proving  that  the  control  parameters,  starting  from 
arbitrary  initial  conditions,  will  converge  to  desired  values,  consequently  re- 
sulting in  the  output  error  signal  tending  to  zero  asymptotically.  While  most  of 
the  adaptive  controllers  described  in  the  literature  are  locally  asymptotically 
stable,  very  little  was  done  until  recently  in  the  design  of  such  globally  stable 
controllers . 

Monopoli  (1974)  suggested  an  ingenious  method  of  adaptive  control  using  an 
augmented  error  signal.  However,  the  basic  question  of  stability  was  left  unanswered 


f n l hat  papei  . 
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existed  and  became'  the  subject  of  discussion  of  subsequent  papers  by  Feuer  and 
Morse  (1977)  and  Narendra  and  Valavani  (1977).  Feuer  and  Morse  (1977)  suggested 
a complex  controller  structure  and  showed  the  stability  of  the  adaptive  loop. 
Unfortunately,  the  motivation  for  the  choice  of  the  controller  structure  as  well 
as  the  development  of  the  stability  proofs  are  rather  difficult  to  follow.  As 
the  authors  readily  admit,  their  results  are  primarily  to  establish  the  existence 
of  a solution  rather  than  to  have  a practical  method  for  the  adaptive  control  of 
an  unknown  plant. 

Narendra  and  Valavani  (1977)  proposed  a general  approach  for  the  adjustment 
of  the  control  parameters  using  the  concept  of  positive  realness  which  resulted 
in  a simple  controller  structure.  The  stability  problem  was  clarified  in  that 
paper  and  a conjecture  was  made  regarding  the  uniform  asymptotic  stability  of  the 
overall  adaptive  loop.  In  this  paper,  a unified  approach  to  direct  and  indirect 
control  is  presented.  It  is  shown,  that  by  the  proper  choice  of  the  observer 
and  controller  structures  the  two  approaches  can  be  made  identical.  The  stability 
problem  for  indirect  control  is  consequently  the  same  as  that  for  the  case  of 
direct  control  and  the  conjecture  made  earlier  applies  here  as  well. 

The  new  scheme  is  considerably  simpler  to  implement  than  that  suggested  pre- 
viously by  the  authors.  The  simulation  results  included  in  the  paper  indicate  that 
the  method  is  sufficiently  robust  to  be  used  in  real  applications.  In  addition  to 
enjoying  practical  advantages,  the  method  proposed  here  also  reveals  the  close 
connection  that  exists  between  two  philosophically  different  approaches;  the  direct 
control  of  an  unknown  plant  using  a reference  model  and  sensitivity  functions  re- 
quires the  same  information  needed  to  identify  the  plant  using  indirect  control. 
INDIRECT  AND  DIR1XT  CONTROL  PROBLEMS:  The  plant  that  is  to  be  controlled  has  the 
Input-output  pair  {u(t),y  (t)}  which  can  be  modeled  by  a linear  time-invariant  sys- 
tem described  by  the  differential  equations: 


i 
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x = A x + b u(t) 

P P P P 
,T 

y = h x 
P P 

Where  A is  an  (nxn)  matrix,  h and  b are  constant  n-vectors  and  the  transfer 
P P P 

function  W (s)  of  the  plant  may  be  represented  as: 

P 

AT  -1  Z (S) 

W (s)  = h (sI-A  ) b = k P . 
p p p p R (s) 


(1) 


(2) 


W (s)  is  strictly  proper  with  Z (s)  a monic  Hurwitz  polynomial  of  degree  m,  R (s) 

p p p 

a monic  polynomial  of  degree  n and  k a constant  gain  parameter.  We  also  assume 

that  only  m,n  and  the  sign  of  k are  known  for  the  design  of  the  controller. 

The  output  behavior  expected  from  the  plant,  when  it  is  suitably  augmented  by 

a controller,  is  described  by  y (t),  the  output  of  a model  M.  The  model  has  a 

M 

reference  input  r(t)  which  is  piecewise  continuous  and  uniformly  bounded  and  a 

transfer  function  denoted  by  W (s)  where 

M 


M Rm(s) 

Z (s)  in  (3)  is  a monic  Hurwitz  polynomial  of  degree  m,  R (s)  is  a monic  Hurwitz 
M M 

polynomial  of  degree  n and  is  a constant.  The  error  between  plant  output  and 
the  desired  model  output  is  defined  by 


(3) 


el(t)  = yp(t)  “ yM(t) 


(A) 


The  principal  requirement  on  the  controller  that  has  to  be  designed  is  that  it  be 

free  of  differentiators.  This,  in  turn,  implies  that  the  model  transfer  function 

W (s)  must  be  such  that 
M 

(number  of  poles)  - (number  of  zeros)  >.  n - m 

(While  the  model  transfer  function  can  contain  n^  poles  and  m^  zeros  where 
n - n»j  i n - m,  we  shall  for  simplicity  assume  throughout  this  paper  that  n^  = n 
and  mj  = ro] . 


Indirect  Control:  The  basic  philosophy  of  this  approach  is  to  estimate  the 


parameters  of  the  unknown  plant  from  input-output  data  and,  in  turn,  use  these 
estimates  to  adjust  the  parameters  of  a controller  such  that  the  transfer  function 
of  the  controlled  plant  evolves  to  that  of  a model. 

Direct  Control:  Unlike  the  previous  case,  no  explicit  plant  identification  is  in- 
volved in  direct  control.  However,  explicit  use  of  a model  described  by  (3)  is  used 
and  the  generated  error  e^(t)  is  directly  used  in  the  adaptive  control  laws. 

The  adaptive  control  problem  using  indirect  or  direct  control  may  now  be  stated 

as  follows:  Given  a plant  P with  an  input-output  pair  {u(t),y  (t)}  determine  a 

P 

suitable  control  input  u(t)  such  that 

lim  | e (t) | = 1 im  |y  (t)  - y (t)|  = 0 (5) 

1 p M 

£ Xjn  £ wr  * 

where  y (t)  is  a desired  output. 

M 

The  principal  difference  between  indirect  and  direct  control  as  stated  in  this 
paper  lies  in  the  following  two  facts: 

(i)  a model  of  the  desired  behavior  is  explicitly  used  in  direct  control  while  a 
model  of  the  plant  identified  on  line  is  used  in  indirect  control. 

(ii)  identification  error  in  indirect  control  and  control  error  in  direct  control 
are  used  to  update  the  control  parameters. 

In  the  following  sections  we  shall  discuss  the  close  relation  that  exists  be- 
tween the  controller  structure,  adaptive  laws  and  stability  questions  that  arise 
in  these  two  approaches. 

A Simple  Case  of  Direct  Control:  The  general  method  of  direct  control  discussed 
by  Narendra  and  Valavani  (1977)  is  best  explained  in  terms  of  the  simple  con- 
figuration shown  in  Fig.  1 with  a single  adjustable  parameter  k(t). 


Fig.  I 

The  reference  model  has  a positive  real  transfer  function  W^(s).  The  plant 

has  a transfer  function  W (s)  and  the  controller  contains  a single  adjustable 

P 

parameter  k(t)  as  shown  in  Fig.  1 so  that  the  input  to  the  plant  u(t)  = r(t)  + k(t)v(t). 

* 

It  is  also  known  that  for  some  constant  value  k of  k,  the  transfer  function  of  the 

plant  with  the  controller  matches  that  of  the  model  exactly. 

* 

If  k(t)  = k + 4>(t),  the  system  governing  the  error  e^(t)  may  be  represented 
as  shown  in  Fig.  2.  The  problem  now  is  to  adjust  4>(t)  such  that  e^(t)  tends  to  zero 
asymptotically  with  time.  It  is  well-known  that  with  such  a configuration,  the 


Fig.  2 
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ndaptivo  law 


k(t)  = <t>  (t)  = -ej  (t)v(t) 


yields  bounded  signals  e^(t)  and  <}>  ( t ) for  any  input  v(t)  (whether  or  not  it  is 
bounded).  If  v(t)  Is  bounded,  litn  e (t)  = 0 or  the  error  e (t)  tends  to  zero. 

£-X» 

Further,  if  v(t)  is  "sufficiently  rich"  in  addition,  Morgan  and  Narendra  (1977) 

have  shown  that  4>(t)  + 0 as  t + ” or  the  parameter  error  also  tends  to  zero. ^ 

In  the  problem  under  consideration,  if  the  output  of  the  model  is  bounded,  the 

boundedness  of  e (t)  implies  the  boundedness  of  y (t)  and  hence  v(t).  Hence 
1 P 

* 

e^(t)  0 as  t Further,  if  the  reference  input  is  sufficiently  rich,k(t)  -*■  k . 

In  the  above  analysis  the  principal  simplification  arises  from  the  fact  that 
the  reference  model  is  positive  real.  The  more  realistic  case  arises  when  the 
model  is  stable  but  is  not  positive  real.  In  such  a case  the  parameter  k is  re- 
placed by  P^(k)  as  shown  below.  [For  a more  detailed  presentation  of  this  operator 
the  reader  is  referred  to  Narendra  and  Valavani  (1977)]. 

If  L(s)  is  a Hurwitz  polynomial  of  degree  n^  in  the  differential  operator  's' 
and  9(t)  is  any  bounded  differentiable  function  of  time,  the  operator  P (0)  is 

Li 

defined  as 

P (0)  = L(s)0(t)L_1(s)  . (7) 

* i 

From  the  definition  of  P (0)  it  follows  that  it  is  (i)  linear  in  0(t),  (ii)  P (0  ) = 0 

L L» 

★ * 

for  a constant  0 , (iii)  P.  (9)  - 0 = P (<t> ) - 4>,  where  9(t)  =0  + t(t). 

Li  L 

If  l.(s)  is  such  that  W(s)L(s)  is  positive  real,  the  parameter  k(t)  in  the 
feedback  loop  can  be  replaced  by  P (k(t))  and  the  same  arguments  can  be  used  as 

Lt 

before  to  determine  the  adaptive  laws.  In  this  case 


It  is  a commonly  observed  fact  that  in  most  adaptive  control  situations  the 
parameter  errors  do  not  tend  to  zero.  Qualitatively  this  may  be  accounted 
for  bv  the  fact  that  as  the  adaptation  proceeds  the  input  u(t)  to  the  plant 
ceases  to  be  "suf f ic ient 1 v rich". 
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k(t)  = e^Ocd)  (8) 

where  i;(t)  = L 1(s)v(t)  . 

The  use  of  the  operator  L(s)  in  the  above  analysis  implies  the  use  of 
derivatives  in  the  feedback  loop.  Since  the  controller  is  to  be  free  of  differ- 
entiators, the  following  procedure  which  involves  feeding  an  auxiliary  input  to 
the  model  (free  of  differentiators)  was  suggested. 

The  adaptive  laws  given  in  (8)  can  be  generated  when  k(t)  in  Fig.  1 is  re- 
placed by  P^(k(t)).  In  Fig.  3 the  signal  k(t)v(t)  is  fed  back  into  the  plant  and 
the  signal  [k(t)  - P^(k(t) ) ]v(t)  is  fed  back  into  the  model  resulting  in  an  error 
equation  which  is  identical  to  that  obtained  in  the  earlier  case  and  hence  the 
adaptive  laws  have  the  same  form  given  in  (8). 


Fig.  3 

It  may  appear  at  first  sight  that  we  have  merely  shifted  the  use  of  differ- 
entiators to  the  model  from  the  plant  since  |k(t)  - P (k(t))l  involves  differentia- 
tions. However,  since  the  model  (which  is  transparent)  has  n poles  and  m zeros  and 

the  degree  of  L(s)  is  n.  = n - m - 1,  the  operator  L(s)W  (s)  can  be  realized  without 

1 M 

the  use  of  differentiators  by  the  proper  choice  of  the  model,  as  shown  in  Fig.  . 


It  is  this  procedure  with  some  modifications  that  was  suggested  by  Narendra 
and  Valavani  (1977)  for  the  adaptive  control  of  an  unknown  plant.  In  the  following 
sections  the  extension  of  the  above  ideas  to  the  general  direct  control  problem  and 
its  relation  to  the  indirect  control  problem  are  examined. 

TJ ie_  Observer  Structure  for  Indirect  Control : 

As  mentioned  earlier,  the  observer  plays  a central  role  in  the  indirect  control 
problem.  The  parameters  of  the  plant  are  continuously  estimated  and  these  estimates, 
in  turn,  are  used  to  determine  the  control  parameters  of  the  system.  The  rationale 
behind  such  an  adjustment  is  that,when  the  identification  parameters  tend  to  their 
true  values,  the  control  parameters  will  also  approach  their  desired  values  for 
which  the  transfer  function  of  the  feedback  loop  will  match  that  of  a specified 
reference  m<~-lel.  Narendra  and  Valavani  [1976]  showed  that  the  above  approach 
generally  leads  to  nonlinear  stability  problems  which  are  intractable.  The  principal 
difficulty  in  such  cases  arises  when  attempting  to  relate  estimates  of  the  identifi- 


cation parameters  to  those  of  the  control  parameters. 
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In  this  section,  we  suggest  an  observer  structure  which  yields  a simple 
relation  between  observer  and  controller  parameters.  In  indirect  control  a 
reference  model  is  not  explicitly  used  to  generate  the  desired  output  but  is 
contained  implicitly  in  the  rule  for  updating  the  control  parameters.  As  shown 
in  this  section,  the  simplification  that  results  from  using  the  new  observer 


structure  is  partly  due  to  the  specific  manner  in  which  the  reference  model  is 
embedded  in  the  adaptive  observer. 

The  following  lemma  and  corollaries  are  needed  to  justify  the  observer 
structure. 

Lemma  1 : (liven  the  relatively  prime  polynomials  p and  q of  degrees  m (<  n-1)  and 


n respectively,  with  q monic,  a monic  polynomial  T and  a polynomial  A of  degree 
(n-1)  exist  such  that  the  polynomial 


fq  + Ap  = M 


where  M is  any  (2n-l)  degree  monic  polynomial.  vi'his  lemma  was  also  used  in  the 
Direct  Control  Problem  in  |6]). 


Proof : Since  p and  q are  relatively  prime,  polynomials  a and  6 of 

degrees  (m-1)  and  (n-1),  where  m ^ 1,  exist  such  that 


aq  + Bp  = 1. 


(For  a detailed  proof  of  the  above,  the  reader  is  referred  to  [ €>  ] , Lemma  2) 
Let  M be  the  monic  polynomial  of  degree  (<)  2n-l.  Then 


Maq  + MBp  - M 


If  N is  the  proper  part  of  — , 

q 


— = N + — , where  A is  of  degree  (<)  n-1. 

q q 


We  then  have 


(M«  + Np)q  + (MR-Nq)p  = M 

where  Mu  + Np  is  a monic  polynomial  of  degree  n-1  and  MB-Nq  = A is  of  degree 
<:  (n-1).  Choosing  Mnt  + Np  = T,  the  result  follows. 

Corollary  1;  If  M is  any  monic  polynomial  of  degree  (2n-f-m-l)  such  that  = Mo 

where  o is  a monic  polynomial  of  degree  m,  polynomials  F,  and  A^  of  degrees 
(m+n-1)  exist  which  satisfy 


V + V = M! 

This  follows  directly  from  Lemma  1 by  choosing 


To  and 


Aa. 


Corollary  2:  Given  two  polynomials  p(s)  and  qM(s)  of  degrees  (n-m-1)  and  n 
respectively,  if  p(s)  and  q(s)  are  relatively  prime  polynomials  of  degrees  m and  n, 
then  the  rational  function  p(s)/q(s)  can  be  expressed  as 

EM  (q) 

q(s)  qM(s)p(s)  + A(s) 

by  the  proper  choice  of  the  polynomials  T(s)  and  A(s)  of  degree  (n-1). 

Proof : Equation  (9)  implies  Tq  - Ap  = p(s)qM(s)p (s)  and  since  the  right  hand  side 

is  of  degree  (2n-l)  the  lemma  applies  directly. 

Representation  of  Plant  Transfer  Function: 

From  Corollary  2 it  follows  that  if  a plant  has  a transfer  function  p(s)/q(s) 

with  m zeros  and  n poles,  it  can  be  represented  in  an  equivalent  form  as  shown  in 

* * 

Figure  5b,  with  A(s)  = pw(s)p(s)  and  p(s)  an  (n-m-1)  degree  polynomial,  T (s),A  (s) 
and  A(s),  (n-1)  degree  polynomials  in  's'  and  a fixed  part  in  the  forward  loop  with 
transfer  function  p,,(s)/qu(s)  where  p..(s)  and  q_,(s)  are  polynomials  in  's'  of  the 
same  degree  as  p(s)  and  q(s).  The  basic  structure  of  the  adaptive  observer  as 
derived  from  Figure  5b  is  shown  in  5c.  The  polynomials  F(s)  and  A(s)  are  adjusted 


Figure  5b 

An  Equivalent  Representation  of  the  Plant 


Figure  5e 


Structure  of  Adaptive  Observer 


2- 


The  rational  function  — — . = W,  (s)  used  in  the  observer  represents  the  transfer 

qM(s)  M 

function  of  the  reference  model.  The  aim  of  the  control  problem  is  to  generate  a 

suitable  control  signal  u(t)  to  the  plant  so  that  the  plant  output  y (t)  evolves 

P 

asvmptot ical ly  towards  the  desired  output  [W  (s)]r(t).  We  notice  that  instead  of 

M 

using  an  explicit  reference  model  we  embed  it  as  a fixed  part  of  the  observer. 

In  the  following  sections  it  is  shown  that  the  observer  structure  shown  in 
Figure  5c  is  adequate  for  the  control  of  a plant  which  has  (n-1)  zeros  and  n poles 
and  the  reference  model  has  a positive  real  transfer  function.  In  such  a case  the 
indirect  and  direct  control  problems  are  found  to  be  identical.  For  more  general 


cases  this  structure  is  modified  as  described  later  in  this  paper. 


y (t) 

P 


V J 


n <t)w0(t)| 


Reference  Model 


PM(S) 

“«<*>  ‘ ^5) 


Figure  b 


-13- 


The  observer  consists  of  two  auxiliary  signal  generators  F^'  and  ' described  by 


the  (n-l)th  order  vector  differential  equations 


C(1)  - Av<l>  + bu 

w(1)  - vu  + >Vl) 

o 0 

*(2)  . (2) 
v = Av  + bu 

u(2)  _ , v . fiT  (2) 
o Op 


(F,*) 


(f2-) 


b = [0,0 1] 

where  A is  an  (n-l)x(n-l)  stable  matrix.  r ^ ' and  F;'  have  transfer  functions  R^(s) 
and  R2(s)  respectively  for  constant  values,  denoted  by  (*),  of  the  parameters  y^ 
and  6.  (i  = 0 , 1 , . . . ,n-l) . 

R. (s)  = Y * + Y*T(sI-A)~1b  = (12) 


R9(s)  = 6 * + 5*T (sI-A) -1b  = ~ (13) 

2 0 A(s) 

•k  -k 

If  A is  in  companion  form,  y ^ and  <5^  (i  = l,2,...,n-l)  represent  the  coefficients 

n-i-l  * * . * 

of  s of  the  numerator  polynomials  T (s)  and  A (s)  respectively,  and  Yq  and 

k 

6.  the  gains  associated  with  the  signals  u(t)  and  y (t) . The  2n  signals 

0 p 

u(t)  ,v^^  (t)  ,y  (t)  and  v^^(t)  are  used  in  the  identification  procedure  and  the 
P 

corresponding  2n  parameters  used  in  the  observer  are  the  elements  of  a parameter 
vector  n(t).  Defining 

T T 

w r(t)  = [u(t),v^  (t),y  (t),v^  (t)]  (14) 

o p 

nT(t)  = [Y0(t) ,yT(t) ,6Q(t) ,6T(t) ] 


the  estimate  v (t)  of  the  output  of  the  plant  y (t)  is  realized  in  the  observer  as 
P P 

T 

the  output  of  the  reference  model  M when  subjected  to  an  input  n (t)w  (t)  or 
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v (l ) |Wu(s) | | H ‘ (l)w  (i)| 

|>  M o 

The*  ideal  If  leal  ion  error  i j(t)  is  tlu>n  del  ined  as  the*  error  between  plant  and 
observer  outputs: 

f . ( t ) = v ( t ) - y ( t ) . 

1 p P 

The  Controller  Structure:  The  controller  (for  both  direct  and  indirect  control) 

uses  (2n-l)  of  the  signals  generated  by  the  observer  along  with  the  reference  input 

r(t)  to  generate  tin*  input  u(t)  to  the  plant.  If  the  vector  w (t)  is  defined  as 

c 

T T 

w^  (t)  = [r(t),v^  (t)  ,y  (t)  .v*'2^  (t)]  (15) 

and  the  control  parameter  vector  by  6 ( t ) where 

0T(t)  ^ [c0(t),cT(t),d0(t),dT(t)],  (16) 

the  input  u(t)  to  the  plant  is  denoted  by 

u(t)  = 61 (t)w  (t). 

C 

From  equations  (14)  and  (15)  it  is  seen  that  the  (2n-1)  signals  v^^(t),y  (t)  and 

P 

(2) 

v (t)  are  common  to  both  observer  and  controller.  In  addition  to  these,  as 
indicated  in  equation  (15),  the  controller  uses  the  reference  input  r(t)  to 
generate  u(t),  while  the  observer  uses  the  plant  input  u(t)  to  generate  y^(t). 


Comment  1:  For  direct  control,  an  explicit  reference  model  is  used  and  the  control 
parameter  vector  0(t)  is  adjusted  on-line  using  the  control  error  e^(t).  In  indirect 
control  the  identification  parameter  vector  n(t)  is  adjusted  on-line  using  the 
identification  error  E^(t)  and  these,  in  turn,  are  used  to  adjust  9(t).  Since  the 
control  error  e^(t)  is  not  available  in  this  case,  the  entire  adaptation  is  carried 


Throughout  the  paper  both  differential  equations 
in  the  arguments  and,  depending  on  the  context, 
operato’-  or  the  Laplace  transform  variable. 


and  transfer  functions  are  used 
s'  is  used  as  a differential 
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out  using  only  Cj(t). 

Direct  and  Indirect  Control: 

We  shall  assume  in  the  following  sections,  for  simplicity,  that  the  gain 

kM 

k of  the  plant  transfer  function  is  known.  In  such  a case  the  gain  c.  = r—  is 
p U K 

P 

a constant  and  only  (2n-l)  parameters  in  the  controller  have  to  be  adjusted.  Further, 
since  y n = k is  a constant  in  the  observer,  only  (2n-l)  parameters  have  to  be 

0 p 

adjusted  to  identify  the  svstem.  For  convenience,  we  shall  assume  that  k = k =1 

M p 

so  that  c = = 1 and  denote  bv  0(t),n(t),w  (t)  = w (t)  the  (2n-l)  dimensional 

0 0 ' o c 

controller  and  observer  parameter  and  input  vectois  used  in  generating  the  adaptive 
laws . 

Reference  Model  witli  Positive  Real  Transfer  Function : 

The  importance  of  the  specific  observer  structure,  discussed  in  the  previous 
section,  containing  the  reference  model  as  an  integral  part,  becomes  evident  when 
we  consider  the  control  problem  for  the  case  when  the  reference  model  is  positive 
real.  In  this  case  the  identification  vector  n(t)  and  the  control  parameter  vector 
f)(t),  can  be  shown  to  be  the  same  i.e. 

0(t)  = n ( t ) . (17) 

For  direct  control  the  adaptive  laws  are 

0(t)  = e. (t)w  (t) 

1 c 

For  both  direct  and  indirect  control  the  plant  together  with  the  controller  can  be 

described  by  the  nth  order  vector  differential  equation: 

. _ T- 

x = A x + b [ r (t)  - 0(t)  w ( t ) ] 

P P P P c (18) 

T- 

= A x + b [ r ( t ) - e(t)  w (t)j 
p p p o 

yp(t)  = hTxp(t). 


(Plant) 
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The  observer  used  in  indirect  control  can  be  described  by  the  differential 
equation 


x =•  + bM[u(t)  + n (t)wo(t)]  = A^U)  + bMr(t) 


(Observer)  y^(t)  = h x(t) 


where  y (t)  is  the  estimate  of  y (t)  and  x(t)  is  some  linear  transformation  of 
o p 

the  estimate  of  x^(t).  Equation  (19)  is  found  to  be  a convenient  minimal  representa- 
tion of  the  model.  However,  for  estimating  the  state  errors,  the  following  non- 
minimal  representation  of  both  plant  and  model  using  a (3n-2)  dimensional  state 
space  is  found  to  be  more  suitable.  The  nonminima]  reference  model  is  obtained 

— -k 

using  the  fact  that  the  parameter  vector  0 makes  the  plant  transfer  function 
identical  to  that  of  the  model  (by  Lemma  1). 

Defining  x"  = [x  T, v^", v^] 

C P 

. -T  A T .(1)T  . (2) F, 

and  x = [x  ,v  ,vv  ' ] 
c p 

x = A x + b[r-<}iTw]  (20) 

c c c c - c 

x = Ax  + b [u(t)  + nT(t)w  (t)]  = A x + b r(t) 
c c C C O c c c 

-*  T 

where  ♦ = 0 - 0 , b = [0,0, ...0,1]  is  an  (n-1)  dimensional  vector,  and  the  matrix 


A and  vector  b are  given  by 


* T 

A + d b h 

P o P 

* T 

i b c 

P 

. *f  ; 

*r 

b d 

P 

*T 

I 

A = 

bd  h 

A+bc  1 

bd 

; b = 

c 

Q 

T 

bh 

1 o 

A 

c 

and  A is  asymptotically  stable, 
c 

The  state  error  equation  may  now  be  described  by  the  vector  differential 
equation 


i 


-17- 


e = x - x = A e + b [ — <f>  T w ] = A € + b [-<t>  (t)] 

C C C CC  q 1 _ C CC  q v — o 

0 n 


(21) 


and  the  adaptive  laws  for  indirect  control  are 


n(t)  = ci(t)wo(t). 

• • 

Since  0(t)  * p(t)  by  equation  (17)  and  w^(t)  = wQ(t)  by  definition,  it  follows 
that  in  this  case,  for  both  direct  and  indirect  control,  either  the  control  error 
e^(t)  or  the  identification  error  e^(t)  can  be  used  to  adjust  the  parameters. 

The  simplicity  of  the  adaptive  laws  is  seen  to  be  due  to  equation  (17)  by 
which  the  control  and  identification  parameters  are  identical  (c^(t)  = y^(t); 
dj(t)  = 6 j ( t ) ; i = 1,2, ...n-1;  j = 0,1,2, .. .n-1) . 

If  the  initial  values  for  the  identification  and  control  parameter  vectors 
are  chosen  as 

n(0)  = 0(0)  = o 

the  input  u(t)  to  the  plant  may  be  represented  as 


u ( t ) = r (t)  - nT(t)w  (t) 

c 

and  the  input  to  the  reference  model  in  the  adaptive  observer  is  r(t).  This,  in 
turn,  implies  that  the  output  of  the  adaptive  observer  is  exactly  the  same  as  the 
output  of  the  reference  model  in  the  direct  control  case. 

The  above  discussion  is  merely  to  emphasize  that,  when  the  reference  model  is 
positive  real,  there  exists  a parametrization  of  the  plant  such  that  the  control 
parameters  obtained  using  direct  control  also  simultaneously  identify  the  plant. 

The  equivalence  of  the  two  approaches  is  obvious  from  Figure  6. 

Comment : The  observer  output  y^(t)  was  seen  to  be  the  same  as  the  output  of  the 

reference  model  in  the  case  of  direct  control.  This  is  due  to  the  fact  that  the 

-T 

plant  is  being  identified  as  a part  of  a closed  loop  and  the  same  signal  n (t)w  (t) 

o 

Is  used  botli  for  identification  and  control. 
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I 1 


Reference  Model  with  Non-Posit Ive  Real  Transfer  Function: 

It  was  shown  in  an  earlier  section  that  when  the  reference  model  has  a 

transfer  function  W (s)  which  is  not  positive  real,  the  direct  control  problem 
M 

can  still  he  resolved  by  replacing  all  control  parameters  0 ( t ) by  P (0  (t)),  where 

i Li 

Pj  (6)  = L(s)0(t)L  ^(s)  and  W^(s)L(s)  is  positive  real.  We  shall  use  a similar 
procedure  in  this  section  for  the  indirect  control  problem. 

When  the  reference  model  is  not  positive  real,  the  observer  structure  suggested 
in  the  previous  section,  while  still  valid,  is  no  longer  useful  directly  for 
identifying  the  parameters  n(t).  However,  if  n(t)  is  replaced  by  P.(n(t))  where 

L 

W fs)L(s)  is  positive  real,  the  same  identification  procedure  can  still  be  used. 

M 

Figure  7 shows  how  the  observer  can  be  realized  without  using  differentiators. 


Figure  7 

The  controller  still  has  the  same  structure  as  before  with  6(t)  = n(t).  The 
estimate  of  the  plant  output  as  given  by  the  observer  is  now 

y(t)  = W ( s ) f r ( t ) + (P  (n(t))  - n(t))Tw  (t)l  (22) 

p n 1,  u 

where  the  second  term  in  the  right-hand  side  has  to  tend  to  zero  asymptotically 
il  the  adaptive  control  is  stable.  But  y^(t)  as  given  by  equation  (22)  is  pre- 
cisely the  output  of  the  reference  model  in  the  direct  control  case.  More  speci- 
fically, we  can  write  the  state  equations  for  indirect  control  corresponding  to 


equations  (20)  in  the  previous  case,  as  follows: 


x = A x + b (L(s){L-1(s)r(t)  - L_1(s)4>Tw  (t ) } ] = 
c c c c - o 

= A x + b [L  1(s)r(t)  - L l(s)<fTw  (t)] 

<-  C PR  r O 


(23) 


T - 1 T 

where  h (sI-A  ) b W (s)  and  h (sI-A  )bnn  = W (s)L(s)  is  positive  real. 
C c M C r K M 

*c  = Ac*c  + bpR[L-l(s)r(t)  + L_1(PL(<f_)  - ♦g>Tw)(t>l  = 

= Ac*c  + bpR[  L J(s)r(t)  + ’ - L l^)wo(t)] 

0 


(24) 


From  equations  (23)  and  (24)  the  identification  error  vector  c (t)  is  governed  by 


the  differential  equation 


e 

c 


A f. 
c c 


+ bPR^I'1«o(t) 


A E + b $T5  (t) 
c c PR  ^ o 


where  Z,  (t) 
o 


= L 1 (s)wo(t) . 


(25) 


Equation  (25)  above  implies  that  the  specific  parametr ization  of  the  plant 
used  to  design  the  observer  yields  an  observer  output  which  is  indistinguishable 
from  the  output  of  the  reference  model  in  the  direct  control  case.  By  emphasizing 
identification  prior  to  control,  we  have  merely  restructured  the  entire  configuration 
of  the  overall  adaptive  system.  In  this  form,  the  adaptive  loop,  though  equivalent, 
is  considerably  simpler  to  implement  than  in  the  direct  control  case. 

Comment : It  has  been  shown  that  the  error  equations  for  both  direct  and  indirect 

control  are  the  same.  Consequently,  the  adaptive  laws  for  updating  the  parameters 
are  also  identical. 

In  direct  control  [6],  two  transfer  functions  of  degree  (n-m-1)  were  needed 
for  the  adjustment  of  every  parameter  in  the  controller  in  addition  to  the  two  auxili- 
ary signal  generators,  when  the  model  is  not  positive  real.  The  scheme  proposed  here 
uses  only  one  such  transfer  function  for  the  adjustment  of  each  parameter  and  a 


Figure  8 


Simulation  Results:  The  new  scheme  proposed  in  the  previous  section,  while 
mathematically  identical  to  that  proposed  in  [6)  is  much  simpler  to  implement. 
Simulation  results  on  the  digital  computer  clearly  demonstrate  that  the  method  can 
be  applied  in  practical  situations  for  the  control  of  unknown  unstable  plants. 

Six  typical  examples  are  presented  in  this  section  and  are  shown  in  Figures 
10  to  12.  The  plant  has  a fourth  order  transfer  function  and  is  unstable  in 
three  of  iho  six  cases  simulated.  Model  transfer  functions  with  one,  two  and 
three  zeros  and  four  poles  arc  considered.  Identification  and  control  parameters 


have  zero  ii  itial  values  and  a square  wave  reference  input  is  used  in  all  cases. 
In  direct  control  the  primary  aim  is  to  drive  the  output  error  to  zero 


Plant: 


Plant 


Figu 


PLANT 


Figure  9 

whether  or  not  the  control  parameters  converge  to  their  desired  values.  In  indirect 
control,  it  has  always  been  assumed  that  the  convergence  of  the  identification 
parameters  to  their  true  values  is  important  for  successful  control.  However,  for 
the  particular  plant  parametrization  used  in  this  paper,  we  have  shown  that  the 
error  equations  for  both  cases  are  identical  and  here  it  is  not  surprising  that 
even  in  indirect  control,  as  the  simulations  show,  the  identification  and  control 
errors  tend  to  zero  asymptotically  without  perfect  identification. 

Stability  Problem  of  Indirect  Control: 


The  convergence  of  observer  parameters  has  been  proven  in  the  past  only  for 
bounded  inputs  (a  reasonable  assumption  in  the  case  of  observers).  However,  in 
the  control  problem  there  is  no  guarantee  that  the  feedback  loop  will  be  stable 
and  hence  that  the  input  u(t)  to  the  plant  will  be  bounded.  It  is  this  fact  that 
raises  the  principal  question  regarding  the  convergence  of  both  observer  and  con- 
troller parameters. 


The  boundedness  of  the  identification  error  r.j(t)  is  assured  whether  or  not 
the  adaptive  Joop  is  stable.  However,  the  possibility  exists  that  both  plant 
and  observer  outputs  are  unbounded  even  while  their  difference  is  bounded.  Our 
main  concern  is,  therefore,  to  demonstrate  the  stability  of  the  feedback  loop. 

In  [6]  a conjecture  was  made  that  when  the  control  error  is  bounded  that  the 
plant  and  model  outputs  would  also  remain  bounded.  A similar  conjecture  can  also 
be  made  in  the  indirect  control  case  i.e.  if  the  identification  error  is  bounded, 
the  plant  and  observer  outputs  must  also  be  bounded.  Figure  12,  which  shows  the 
plant  output  y^(t)  and  its  relation  to  the  identification  error  e^(t)  is  found  to 
be  identical  to  Figure  5a  in  [6]  relating  control  error  to  y (t). 


' 


Figure  13 

The  above  comments  imply  that  if  the  conjecture  made  by  Narendra  and  Valavani 
(1977)  is  correct,  the  stability  problems  of  both  direct  and  indirect  control  can 
be  resolved  simultaneously  and  stable  adaptive  control  can  be  achieved  using  either 
the  control  error  e^t)  or  the  identification  error  e^t). 
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